Object creation using body gestures

ABSTRACT

An intuitive interface may allow users of a computing device (e.g., children, etc.) to create imaginary three dimensional (3D) objects of any shape using body gestures performed by the users as a primary or only input. A user may make motions while in front of an imaging device that senses movement of the user. The interface may allow first-person and/or third person interaction during creation of objects, which may map a body of a user to a body of an object presented by a display. In an example process, the user may start by scanning an arbitrary body gesture into an initial shape of an object. Next, the user may perform various gestures using his body, which may result in various edits to the object. After the object is completed, the object may be animated, possibly based on movements of the user.

CROSS-REFERENCE TO RELATED PATENT APPLICATIONS

This application is a Continuation Application of U.S. patentapplication Ser. No. 15/888,572, filed Feb. 5, 2018, which is aContinuation Application of U.S. patent application Ser. No. 14/770,800,filed Aug. 26, 2015, now U.S. Pat. No. 9,928,634 issued Mar. 27, 2018,which is a 371 National Phase of Patent Cooperation Treaty ApplicationNo. PCT/CN2013/072067, filed Mar. 1, 2013, each of which is hereinincorporated by reference in its entirety.

BACKGROUND

Many video games feature avatars that are controllable by one or moreplayers of the games. Some games allow a player to select an avatar thatthe player then controls during the game. Typically, avatars areselected from existing avatars that may or may not be customized.Customization often includes changing colors, basic attributes, or otherfeatures by selecting from various choices provided by the game. Thus,the creation or modification of avatars is often limited to a finiteamount of possibilities that are dictated by the designer of the game.

Three dimensional (3D) modeling is traditionally accomplished usingsophisticated and expensive 3D computer graphics software that requiressome formal training to operate and is not intuitive to the generalpopulation. Creating even simple objects, such as a simple avatar, usinggraphics software can be time consuming and require many steps.

More recently, imaging software allows users to convert two dimensional(2D) images into 3D model. This may allow a user to select an objectfrom the real world, obtain 2D images of the object, and then convertthe images into a virtual 3D object. However, modification of thevirtual 3D object still presents challenges and may be time consumingand require many steps.

SUMMARY

An intuitive interface may allow users of a computing device (e.g.,children, etc.) to create imaginary three dimensional (3D) objects ofany shape using body gestures performed by the users as a primary oronly input. A user may make gestures (motions) while in front of animaging device that senses movement of the user.

The interface may employ a mapping perspective that is maintainedbetween the user and the 3D object. The mapping may be a body referencemapping where the user is mapped to a similar location as the 3D objectto allow the user to interact with the 3D object in a first-personediting perspective (as if the user were inside of the 3D object or werethe 3D object). The mapping may be a spatial mapping where the user ismapped to a location outside of the 3D object to allow the user tointeract with the 3D object in a third-person editing perspective(allowing the user to walk around the 3D object, etc.).

In some embodiments, the user may start by scanning an arbitrary bodygesture into an initial shape of a 3D object. Next, the user may performvarious gestures using his body, which may result in various edits tothe 3D object. An edit may include selection of a surface or part of asurface of the 3D object based on a first part of the body gestureperformed by the user and modifying the surface of the 3D object basedon a second part of the body gesture of the user. After the 3D object iscompleted, the 3D object may be animated, possibly based on movements ofthe user.

This Summary is provided to introduce a selection of concepts in asimplified form that are further described below in the DetailedDescription. This Summary is not intended to identify key features oressential features of the claimed subject matter, nor is it intended tobe used to limit the scope of the claimed subject matter.

BRIEF DESCRIPTION OF THE DRAWINGS

The detailed description is described with reference to the accompanyingfigures. In the figures, the left-most digit(s) of a reference numberidentifies the figure in which the reference number first appears. Thesame reference numbers in different figures indicate similar oridentical items.

FIG. 1 is a schematic diagram of an illustrative environment thatincludes a computing architecture to model three dimensional (3D)objects using body gestures performed by a user.

FIG. 2 is a flow diagram of an illustrative process of creating objectsusing body gestures.

FIG. 3 is a schematic diagram of a computing architecture to enablecreation and animation of avatars using body gestures.

FIG. 4 is a flow diagram of an illustrative process of creating andanimating an avatar using body gestures.

FIGS. 5A and 5B are pictorial flow diagrams of an illustrative processof creating and editing an avatar using body gestures.

FIG. 6 is a schematic diagram of an illustrative environment where thecomputing device includes network connectivity.

DETAILED DESCRIPTION Overview

An intuitive interface may allow users of a computing device (e.g.,children or other users) to create imaginary three dimensional (3D)objects and avatars of any shape using body gestures performed by theusers as a primary or only input. A user may make motions while in frontof an imaging device that senses movement of the user. The interface mayallow first-person and/or third person interaction during creation ofobjects or avatars, which may map a body of a user to a body of anobject or avatar presented by a display. In an example process, the usermay start by scanning an arbitrary body gesture into an initial shape ofan object or avatar. Next, the user may perform various gestures usinghis or her body, which may result in various edits to the object oravatar. After the object or avatar is completed, the object or avatarmay be animated, possibly based on movements of the user.

The processes and systems described herein may be implemented in anumber of ways. Example implementations are provided below withreference to the following figures.

Illustrative Environment

FIG. 1 is a schematic diagram of an illustrative environment 100 thatincludes a computing architecture to model 3D objects using bodygestures. The environment 100 includes a computing device 102 configuredwith a display 104. The computing device 102 may be a gaming console, adesktop computer, a laptop computer, a tablet, a smart phone, or anyother type of computing device capable of receiving inputs from variousdevices (e.g., camera, microphones, etc.) and causing a visual display.The computing device 102 may be in communication with an imaging device106 and a microphone 108. The microphone 108 is shown as beingintegrated with the imaging device 106, but may be implemented as aseparate component. The microphone 108 may be implemented as a singlemicrophone or as a microphone array that can detect a direction of somesounds. In some instances, the microphone 108 may be worn by a user 110and may communicate with the computing device 102 using a wired orwireless connection. In some embodiments, the computing device 102, thedisplay 104, the imaging device 106, and/or the microphone 108 may beintegrated together.

In accordance with various embodiments, the computing device 102 maytrack movement of the user 110 within a zone 112 using the imagingdevice 106. In some embodiments, the imaging device 106 may include oneor more cameras and one or more depth sensors, which may be usedindividually or together to record imagery in the zone 112, sensemovement in the zone 112, determine relative distances of surfaces inthe zone, detect colors, detect shapes (e.g., facial recognition, etc.),and/or perform other imagery functions. In some embodiments, the imagingdevice 106 may create a 3D interpretation of objects and people withinthe zone 112. The zone 112 may be within a room or other predefinedrange and angle from the imaging device 106.

The user 110, while being tracked by the imaging device 106, maycommunicate body gestures by movement of the user's appendages and bodythat, when received by the computing device and interpreted, may causethe computing device 102 to perform certain actions. For example, thebody gestures may be interpreted by the computing device 102 to causecreation and editing of 3D object while the computing device isoperating in a modeling mode. In some embodiments, the object may be anavatar that the user may then animate using body gestures, possiblywhile the computing device 102 is operating in an animation mode. Insome instances, the computing device 102 may simultaneously operate inthe modeling mode and the animation mode.

Body gestures may be any movements of the user 110 that are associatedwith commands that can be interpreted by the computing device 102. Insome instances, the body gestures may be predefined by the computingdevice. However, the computing device 102 may also be capable oflearning new body gestures, which may be assigned to events by the user110. For example, when interacting with the computing device 102, a bodygesture of jumping up and down may cause, after detection, the computingdevice 102 to execute a first operation while a body gesture of reachingout with a hand having a closed fist may cause, after detection, thecomputing device 102 to execute a second operation. Many different typesof body gestures may be recognized by the computing device 102 by way ofimagery captured by the imaging device 106. The body gestures may beperformed by appendages of the user 110 (e.g., movement of a hand, foot,arm, fingers, etc.) and/or by the entire body movement of the user(e.g., jumping). In some embodiments, the gestures may be indicated by acue, such as a signal to indicate that a gesture is to be performedand/or to indicate that the gesture has been completed. The cue may be avoice command, another gesture, a hardware input, and/or another type ofinput.

In addition to body gestures, the computing device 102 may receive voicecommands from the user 110 by way of the microphone 108. The voicecommands may be discrete words (e.g., “stop,” “next,” “menu,” etc.), ormay be commands parsed from natural language commands (e.g., “show methe menu,” causing the computing device 102 to cause display of a menu,etc.).

The computing device 102, in a basic configuration, may include amodeling application 114, an animation application 116, a motiondetection module 118, and a voice command module 120, each discussed inturn.

The modeling application 114 may receive input from the imaging device106 to enable the user 110 to create a 3D model of an object using bodygestures performed by the user 110. The modeling application 114 maycreate and edit objects formed using voxel modeling, implicit surfacemodeling, or other types of 3d modeling. The modeling application 114may create a non-rigid animated object that can be animated by the useror by other inputs.

For example, the user 110 may use her body to create an initial objector shape, such as by forming a first pose with her body. The modelingapplication 114 may interpret the pose and form the initial object. Thecomputing device 102 may cause display of the initial object on thedisplay 104 to provide feedback to the user 110. The user 110 may thenedit the initial object using the modeling application 114. The modelingapplication may recognize gestures, tools, voice commands, and/or otherinputs, and in response perform operations to modify an object 122, suchas the initial object. The modeling application 114 may repeatedly allowthe user 110 to edit and modify the object 122. The modeling application114 may interpret operations such as push a feature, pull a feature,sculpt a feature, sketch a feature, cut a feature, paint a feature, adda special feature, and/or other operations. These operations arediscussed in greater detail below, and specifically with reference toFIGS. 5A and 5B. As shown in FIG. 1, the object 122, such as an avatar,may be presented back to the user 110 by the display 104.

The modeling application 114 may use body-centric coordinate mapping tomap the user 110 to the object being modeled, and thus allowing the user110 to interact with the object using body gestures. In someembodiments, the modeling application 114 may operate in a first personediting mode (body reference mode) or a third person editing mode(spatial mapping mode). The body reference mode may allow the user 110to edit the object as if at least a part of the user 110 is the object.The spatial mapping mode may allow the user 110 to edit the object as ifthe user stepped out of the object and is next to the object. In thespatial mapping mode, the user 110 may freely move about relative to theobject to edit the object from outside the object or edit the objectfrom inside of the object. Thus, the modeling application 114 maydetermine a reference mode for operation (e.g., the spatial mapping modeor the body reference mapping mode), map locations of the user 110 tolocations of the object or locations near the object, and then performoperations to the object based on the body gestures of the user 110.After the user confirms a mapping relation, the user may trigger anaction. By triggering an action, whenever the user 110 touches thesurface or a portion of the surface of the object with any part of herbody, the object will transform accordingly. With body referencemapping, the modeling application 114 maps generally to the user'sskeleton (e.g., use several joints along the line from the head to thefoot, etc.) to a center line of the object (avatar). In this case, theuser is able to touch some parts of her body to navigate to a certainpart/point on the object or avatar. As discussed herein, the term“surface” may be used to mean an entire surface or a portion of asurface.

One main difference between these two mappings is in the spatial mappingmode, the user is free to move relative to the object, such as rotatingand walking around the object or into the object as long as she does nottrigger an editing action, such as by touching, with an editing tool, atleast a portion of a surface mapped to at least a portion of a surfaceof the object. While in the body reference mapping mode, the object willfollow the user's action so that the user will feel that she is theobject herself. When she triggers an action, the modeling application114 will stop the mappings for the editing hand/arm/leg, etc. Forinstance, when the user is using a right hand to edit the object (toucha surface of the object, etc.), the mapping relation between the rightarm and the object may be at least temporarily ignored until the actionis completed.

The animation application 116 may animate the object, such as an avatar.The animation application 116 may create relationships between theuser's movement and the movement of the object. For example, when theobject is an avatar that includes three arms, the animation application116 may map two of the arms to respective arms of the user 110 and maymap the movement of the third arm to one of the user's arms (e.g., leftarm, etc.) or may not map the third arm to the user but instead controlthe third arm based on other information (e.g., random movement,aggregate movement of both the user's arm, etc.). The animationapplication 116 may enable the user to control the avatar (e.g., theobject 122), such as during game play in an adventure game, a sportsgame, an action game, and/or in other games or scenarios.

The motion detection module 118 may capture and interpret movement ofthe user 110 that performs the body gestures. The motion detectionmodule 118 may also capture 3D reference information, such as a pose ofthe user 110 that may be used to create the initial object. The motiondetection module 118 may receive signals from the imaging device 106 andinterpret those signals to enable creation of 3D objects, detection ofbody gestures, and so forth. Thus, the motion detection module 118 mayinterpret the movements and information from imagery captured by theimaging device 106, which may then be processed by the modelingapplication 114 and/or the animation application 116.

The voice command module 120 may capture and interpret sounds from theuser 110 and/or other sounds. The voice command module 120 may interpretthe sounds as voice commands, which may then be processed by themodeling application 114 and/or the animation application 116.

Illustrative Operation

FIG. 2 is a flow diagram of an illustrative process of creating objectsusing body gestures. The process 200 is illustrated as a collection ofblocks in a logical flow graph, which represent a sequence of operationsthat can be implemented in hardware, software, or a combination thereof.In the context of software, the blocks represent computer-executableinstructions that, when executed by one or more processors, cause theone or more processors to perform the recited operations. Generally,computer-executable instructions include routines, programs, objects,components, data structures, and the like that perform particularfunctions or implement particular abstract data types. The order inwhich the operations are described is not intended to be construed as alimitation, and any number of the described blocks can be combined inany order and/or in parallel to implement the process. Other processesdescribed throughout this disclosure, in addition to process 300, shallbe interpreted accordingly. The process 200 is described with referenceto the environment 100. However, the process 200 may be implemented inother environments.

At 202, the modeling application 114 may create or obtain an initial 3Dobject (or shape). For example the modeling application 114 may enablethe user 110 to create the initial object by forming a pose and thencreating a basic 3D model representative of the pose of the user. Forexample, if the user 110 where to kneel down and make her profile lookgenerally like an egg, the initial object may be rendered in the basicshape of an egg. In some embodiments, the modeling application 114 mayenable the user to select an existing object as the initial object. Theexisting object may be retrieved from a library of digital objectsand/or captured from the real world by the imaging device 106 (e.g.,scanning an object in front of the imaging device 106 to create a 3dobject).

At 204, the modeling application 114 may edit the object 122 based onbody gestures performed by the user 110. The modeling application 114may, for example, interpret a body gesture as a “push a feature”operation, and in response, extrude an appendage from the initial objector from a modified form of the object 122.

At 206, the modeling application 114 may provide visual feedback to theuser 110 to show changes to the object 122. The visual feedback may bepresented via the display 104. The modeling application 114 may enablethe user 110 to continually update the object 122 through repeated editsvia the operation 204, which may be shown to the user 110 via theoperation 206.

At 208, the modeling application 114 may save the object (e.g., anavatar). The modeling application 114 may enable use of the object 122by other applications (e.g., games, resources, etc.), and/or may enableanimation of the object, such as by use of the animation application116.

Illustrative Computing Architecture

FIG. 3 is a schematic diagram of a computing architecture 300 to enablecreation and animation of avatars using body gestures. The computingarchitecture 300 shows additional details of the computing device 102,which may include additional modules, libraries, and/or hardware.

The computing architecture 300 may include processor(s) 302 and memory304. The memory 304 may store various modules, applications, programs,or other data. The memory 304 may include instructions that, whenexecuted by the processor(s) 302, cause the processor(s) to perform theoperations described herein for the computing device 102.

The computing device 102 may have additional features and/orfunctionality. For example, the computing device 102 may also includeadditional data storage devices (removable and/or non-removable) suchas, for example, magnetic disks, optical disks, or tape. Such additionalstorage may include removable storage and/or non-removable storage.Computer-readable media may include, at least, two types ofcomputer-readable media, namely computer storage media and communicationmedia. Computer storage media may include volatile and non-volatile,removable, and non-removable media implemented in any method ortechnology for storage of information, such as computer readableinstructions, data structures, program modules, or other data. Thesystem memory, the removable storage and the non-removable storage areall examples of computer storage media. Computer storage media includes,but is not limited to, RAM, ROM, EEPROM, flash memory or other memorytechnology, CD-ROM, digital versatile disks (DVD), or other opticalstorage, magnetic cassettes, magnetic tape, magnetic disk storage orother magnetic storage devices, or any other medium that can be used tostore the desired information and which can be accessed by the computingdevice 102. Any such computer storage media may be part of the computingdevice 102. Moreover, the computer-readable media may includecomputer-executable instructions that, when executed by theprocessor(s), perform various functions and/or operations describedherein.

In contrast, communication media may embody computer-readableinstructions, data structures, program modules, or other data in amodulated data signal, such as a carrier wave, or other mechanism. Asdefined herein, computer storage media does not include communicationmedia.

The memory 304 may store an operating system 306 as well as the modelingapplication 114, the animation application 116, the motion detectionmodule 118, and the voice command module 120.

The modeling application 114 may include various modules such as a toolmodule 308, a mapping module 310, and an editing module 312. Each ofthese modules is discussed in turn.

The tool module 308 may allow selection of tools for use by the user 110to interact with the modeling application 114. The tools may be selectedand identified based on object held by the user, by gestures of theuser, by voice commands, or by a combination thereof. For example, thetool module 308 may detect a prop of a pair of scissors (e.g., plasticscissors, etc.) that are a real world object, held by the user 110, anddetectable by the imaging device 106. The scissors may be associatedwith a type of action, such as an edit feature of cutting. As anotherexample, the tool module 308 may receive a command “cut” or “usescissors” to initiate use of that particular tool. In yet anotherexample, the user may use her fingers to make a scissor action with herindex finger and middle finger moving apart and then back together,which may allow the tool module 308 to identify a desired use of thatparticular tool. Thus, the tool module 308 may enable identification andselection of tools based on at least gestures, voice commands, and/orreal world objects. In some embodiments, the tools may also be selectedfrom preexisting tools (e.g., from a menu.). The tool module 308 maystore references and associated tools in a tool library 314. In someembodiments, the user 110 may define or modify definitions of the toolsin the tool library 314.

In various embodiments, the modeling application 114 may detect tooland/or gestures based on a position of wearable devices, such as aglove. For example, the user may wear a glove, shirt, helmet, or otherwearable devices which can be sensed by the imaging device 106. However,body gestures may be recognized without use of the wearable devicesbased on existing algorithms created for such purposes.

The mapping module 310 may cause the modeling application 114 toalternate between mappings. As discussed above, the modeling application114 may operate in at least two mapping modes: a first person editingmode (body reference mapping mode) and a third person editing mode(spatial mapping mode). The body reference mapping mode may allow theuser 110 to edit the object as if the user 110 was inside of the objector is the object. Thus, the object is mapped at least partially to thebody of the user 110. The spatial mapping mode may allow the user 110 toedit the object as if the user stepped out of the object and is next tothe object. Thus the object is mapped to a position that is differentthan, but accessibly by, the user 110. In this position, the user 110may walk around the object as if the object is a statue being sculptedor otherwise edited by the user 110. The mapping module 310 mayalternate between the modes based on body gestures of the user 110,voice commands, and/or other received selections. For example, the usergesture of “jumping to a side” may cause the mapping module to shiftbetween the mappings. Other gesture commands may be used as well.

The mapping module 310 may manage reference planes and/or reference axesused by the modeling application to maintain mappings between the objectand the user 110. In some embodiments, the user 110 may desire to adjusta mapping such as to rotate the object to enable editing a differentside of the object. The mapping module may cause some actions to snap toor operate in certain ways with respect to the planes/axes, such as tosnap to a plane or axis (e.g., sketching may snap to a plane and then betransformed to a 3D object after the sketch is completed). Thus, themapping module 310 may create and manage reference information for theuser 110 and the object, and may create and maintain a relationshipbetween the reference information via the mappings, based partly on themode of operation (the spatial mapping mode, the body reference mappingmode, etc.).

The editing module 312 may cause creation, selection, and edits to theobject (e.g., the avatar). The edits may modify surfaces of the object.The edits may include operations such as push a feature, pull a feature,sculpt a feature, sketch a feature, cut a feature, paint a feature, adda special feature, and/or other operations. The edit module 312 maydetermine an operation to perform based on various information, such asa tool identified by the tool module 308, a mapping determined by themapping module 310 (including corresponding mappings between the user110 and the object), a location of the tool relative to the object(e.g., on surface of object, near the object), and so forth.

In some embodiments, the editing module 312 may enable the user 110 toobtain parts from a part library 316. For example, the user 110 maydesire to add eyes, ears, and a mouth to her avatar. The eyes, ears,mouth, and other predetermined objects may be selectable from the partlibrary. In some embodiments, the functionality of these parts may beaccessible and/or assignable. For example, the user 110 may create aneye using the editing module, and then assign the function of thecreated eye as the function of seeing, which in turn may modify adisplay during animation of the avatar (e.g., during game play, etc.).Other common parts or user created parts may be stored in the partlibrary and made accessible to the editing module 312. In someembodiments, the part library 316 may be accessible to other computingdevices via a network connection.

In various embodiments, the edit module 312 may provide feedback to theuser 110, via an output to the display of the avatar, to assist inediting the avatar. For example, the edit module 312 may identify aselectable portion of the object (e.g., a portion of a surface of theobject, etc.) about to be edited before the editing occurs, may indicatea currently selected tool, indicate one or more reference planes and/oraxes, and so forth. The user 110 may then use this information prior toor during the editing of the avatar.

In accordance with one or more embodiments, the modeling application 114may enable multi-user operations, such as by enabling two or more usersto design an object while working together. For example, a first usermay act as the object while a second user performs edit operations onthe object (positioned as the first user).

The animation application 116 may include various modules such as ananimation assignment module 318 and an animation module 320. Each ofthese modules is discussed in turn.

The animation assignment module 318 may map motion and animationfeatures of the avatar (created via the modeling application 114) tobody gestures of the user 110. In some embodiments, the animationassignment module 318 may map motion and animation features to relatedparts (e.g., map left arm of avatar to left hand of the user 110).However, when the avatar includes features that do not correspond tofeatures of the user 110, then customized assignments may be performedby the animation assignment module 318. In various embodiments, theanimation assignment module 318 may allow the user 110 to specificmappings and animation of these non-corresponding features. For example,when the avatar includes three arms, the animation application 116 maymap two of the arms to respective arms of the user 110 and may map themovement of the third arm to one of the user's arms (e.g., left arm,etc.) or may not map the third arm to the user but instead control thethird arm based on other information (e.g., random movement, aggregatemovement of both the user's arm, movement of a leg, etc.). As anotherexample, when the avatar does not include legs, the animation assignmentmodule 318 may map a gesture such as jumping with movement of theavatar. The animation assignment module 318 may use a structured processto enable the user to specify mappings of motion to features of theavatar, which may be stored in an animation mapping store 322. In someembodiments, the animation mapping store 322 may include selectableanimations, such as movement of a tail, which can be assigned to afeature of a tail included on the avatar and so forth.

The animation module 320 may cause animation of the avatar byimplementing the animation assignments created by the animationassignment module 318 and stored in the animation mapping store 322. Insome embodiments, the animation application 116 may be used by otherresources, such as other games, applications, and so forth.

Illustrative Operations

FIG. 4 is a flow diagram of an illustrative process 400 of creating andanimating an avatar using body gestures. Similar to the process 200, theprocess 400 is illustrated as a collection of blocks in a logical flowgraph, which represent a sequence of operations that can be implementedin hardware, software, or a combination thereof. The order in which theoperations are described is not intended to be construed as alimitation, and any number of the described blocks can be combined inany order and/or in parallel to implement the process. The process 400is described with reference to the environment 100 and the computingarchitecture 300. However, the process 400 may be implemented in otherenvironments and/or other computing architectures.

At 402, the modeling application 114 may determine an initial shape forthe avatar. For example the modeling application 114 may enable the user110 to create the initial object by forming a pose and then creating abasic 3D model representative of the pose of the user. In someembodiments, the modeling application 114 may enable the user to selectan existing object as the initial shape. For example, the user 110 maycreate the initial shape using a toy or other real or virtual object.

At 404, the tool module 308 may determine a tool for use by the user110. The tool module 308 may determine the tool based on a userselection, which may be a voice command, a body gesture, a menuselection, or another type of selection. For example, the tool module308 may determine the tool based on a prop that is picked up by the user(e.g., a pair of scissors, a wand, etc.).

At 406, the mapping module 310 may determine a mapping for interactionbetween the user 110 and the avatar. For example, the mapping module 310may determine the mapping from a voice command, a gesture, a menuselection, or another type of selection.

At 408, the editing module 312 may cause an edit to the avatar. The editmay change the 3D shape of the initial shape or an edited shape (afterone or more edits to the initial shape). The edits may includeoperations such as push a feature, pull a feature, sculpt a feature,sketch a feature, cut a feature, paint a feature, add a special feature,and/or other operations.

At 410, the modeling application 114 may determine whether to undo anedit. For example, the user 110 may make create a feature using agesture and then decide she does not like the newly created feature orthat the newly created feature was not created as intended. Thus, thedecision operation 410 may enable quick and easy reversion to a versionof the avatar prior to a most recent edit. In some embodiments, thedecision operation 410 may allow the user 110 to undo any number ofedits (features). When the decision operation 410 determines to undo oneor more edits (following the “yes” route from the decision operation410), then the process 400 may advance to an operation 412.

At 412, the one or more edits may be removed, thus reverting back to aprior version of the avatar prior to implementation of one or more editsby the operation 408. Following the operation 408, the process 400 mayreturn to the operation 404, the operation 406, and/or the operation 408to allow the user to continue to edit the avatar, or possibly to a saveoperation 416.

When the decision operation 410 determines not to undo one or more edits(following the “no” route from the decision operation 410), then theprocess 400 may advance to an operation 414. This route may not requireaction by the user 110 (e.g. may be a default route). At 414, themodeling application 114 may determine whether the avatar is completed(typically base on a user selection). When the avatar is not complete(following the “no” route from the decision operation 414), then theprocess 400 may advance to the operation 404, the operation 406, and/orthe operation 408 to continue modifying the avatar.

When the avatar is complete (following the “no” route from the decisionoperation 414), then the process 400 may advance to an operation 416. At416, the modeling application 114 may save the avatar. In someembodiments, the avatar may be saved at other times, such as byautomatic saving performed by the modeling application 114.

At 418, the animation assignment module 318 may allow the user to mapmotion and animation features of the avatar (created via the modelingapplication 114) to body gestures of the user 110. The mapped animationrelationships may be stored in the animation mapping store 322.

At 420, the animation module 320 may cause animation of the avatar basedon user gestures in accordance with the mappings stored in the animationmapping store 322. In some embodiments, the process 400 may enable latermodifications and/or edits to the avatar after the operations 416, 418,and/or 420 by allowing the process 400 to return to the operation 404 orother operations shown in FIG. 4.

FIGS. 5A and 5B are pictorial flow diagrams of an illustrative process500 of creating and editing an avatar using body gestures. Similar tothe process 200 and the process 400, the process 500 is illustrated as acollection of blocks in a logical flow graph, which represent a sequenceof operations that can be implemented in hardware, software, or acombination thereof. The order in which the operations are described isnot intended to be construed as a limitation, and any number of thedescribed blocks can be combined in any order and/or in parallel toimplement the process. The process 500 is described with reference tothe environment 100 and the computing architecture 300. However, theprocess 500 may be implemented in other environments and/or othercomputing architectures.

The process 500 shows a series of edit functions arranged as operationsthat perform edits to an example object (avatar). The order of theoperations is purely illustrative and may occur in any order. In someinstances, the same edit operation may be performed many times whileother edit operations may not be used to create an object. The process500 shows creation of an avatar; however, the process 500 may be used tocreate other objects using body gestures made by the user 110.

Each operation shown in the process includes an associatedrepresentation of an avatar 502. Some operations include a user actionframe (e.g., a user action frame 504) to show how one or more featuresin the operation may be created based on body gestures of the user 110.The user action frame shows an action of the user on the left side ofthe frame and corresponding example change to the object on the rightside of the frame. The user action frames are illustrative of somepossible results of body gestures performed by the user 110.

At 506, the edit module 308 may create or obtain an initial body 508 forthe avatar 502. The user action frame 504 shows the user 110 posing in aposition to create the body 508 of the avatar 502. However, the editmodule 308 may create the body 508 using existing real world objects orvertical objects.

At 510, the edit module 308 may create push features or drag featuresbased on respective body gestures performed by the user 110 and sensedby the motion detection module 118. A push operation may occur when thebody gesture pushes against a surface (or portion of a surface) of theavatar 502, as shown in a user action frame 512. A drag (or pull)operation may occur when the body gesture pulls a surface of the avatar502, as shown in a user action frame 514. The push and pull operationsmay create extrusions such as appendages 516 (e.g., arms, legs, etc.).The push and pull operations may also modify a size or shape of existingfeatures, such as modifying a shape of a head 518 of the avatar 502 bywidening the head (or possibly by shrinking the head, etc.). The pushand pull operations may be performed in the first person editing mode(body reference mapping mode) and/or the third person editing mode(spatial mapping mode). In the body reference mapping mode, the editmodule may determine that the user's gesture is a push against a surfaceof the avatar 502 outwards as if the user 110 was inside of the avatar.In the spatial mapping mode, the edit module 308 may determine that theuser's gesture is pull from a surface of the avatar 502 outwards as ifthe user 110 were outside of the avatar and pulling a part of theavatar. The push/pull operation may start and stop following cues. Astart cue may be an identification of a tool touching a surface of theavatar. The extrusion may stop after the use performs a gesture to stopthe push or pull operation (e.g., releases clamped hand, pauses for apredetermined amount of time, etc.).

At 520, the edit module 308 may add special features 522 to the avatar502. The special features 522 may be obtained from the parts library316. For example the user may add special features of eyes and a mouth524 to the avatar. The special features 522 may be added to the avatarusing any mapping mode. In some embodiments, the special features 522may be added by selecting the special feature (via gestures, voicecommands, and/or menu selections) and then touching a location on theavatar to place the special features. In some instances, the specialfeatures may include assignment of functionality, such as an ability tohear, to see, and so forth. These sensory attributes may be added toexisting features using the editing module 308 in some embodiments.Thus, the editing module 308 may assign sensory attributes and/or partsto specific locations on the avatar based on body gestures performed bythe user 110.

Moving to FIG. 5B, at 524, the edit module 308 may create sculptfeatures or sketch features based on respective body gestures performedby the user 110 and sensed by the motion detection module 118. A sculptoperation may occur when the body gesture moves over a surface to definea new profile or location for an adjacent surface. A user action frame528 shows an example sculpt operation to create a paunch for an avatar.An example sculpted feature 530 is shown on the avatar 502.

A sketch operation may occur when the body gesture draws an outline on asurface or plane (e.g., a reference plane provided by the mapping module310). A user action frame 532 shows an example sketch operation tocreate hair 534 (or a mane) for the avatar 502. In another example, theedit module 208 may be used to sketch a tail 536. The tail may also becreated by other edit operations, such as the drag operation. Thus, somefeatures may be created using one or more different edit operations.

When implementing the sketch operation, the edit module 308 may firstplace the sketch on a plane or other surface, and then associate orconnect the sketch to the avatar 502. The edit module 308 may transformthe sketch to a 3D sketch by adding volume to a resultant feature, suchas volume to the tail 536 or the hair 534. The sculpt operation and thesketch operation may be performed in the first person editing mode (thebody reference mapping mode) and/or the third person editing mode(spatial mapping mode).

At 538, the edit module 308 may cut features based on respective bodygestures performed by the user 110 and sensed by the motion detectionmodule 118. A cut operation may occur when the body gesture moves into asurface of the avatar 502, such as shown in a user action frame 540. Thecut operation may be used to reduce a size, shape, or volume of anexisting feature. For example, the gestures by a user may motion to cutthe size of the arms 542 of the avatar to make the arms narrower. Insome embodiments, the cut operation may be performed using a same orsimilar algorithm as the push/pull operations, but may reduce the sizeof a feature rather than increase a size of a feature. The cut operationmay be performed in the first person editing mode (body referencemapping mode) and/or the third person editing mode (spatial mappingmode).

At 544, the edit module 308 may paint colors, textures, patterns,clothing, and/or other features on the avatar. The paint operation maybe performed by selecting a paint attribute (e.g., colors, textures,patterns, clothing, etc.), and then applying the paint attribute to asurface using a body gesture, such as shown in a user action frame 546.For example, the user 110 may add color, texture, etc. to the hair 548and or add color, texture, clothing, markings, etc. to a body 550 of theavatar. In some embodiments, the paint feature may enable selection ofcolors, textures, or other paint attributes from attributes of existingobject (real objects and/or virtual objects).

Illustrative Operations

FIG. 6 is a schematic diagram of an illustrative environment 600 wherethe computing device 102 includes network connectivity. The environment600 may include communication between the computing device 102 and oneor more remote resources, such as remote resources 602(1), 602(2), . . ., 602(N) through one or more networks 604. The networks may includewired or wireless networks, such as Wi-Fi networks, mobile telephonenetworks, and so forth.

The remote resources 602(1)-(N) may host some of the functions shown inthe computing architecture 300. For example, the remote resources602(1)-(N) may store the avatar for access in other computingenvironments, may perform the animation processes or portions thereof,may perform the modeling processes or portions thereof, and so forth.The remote resources 602(1)-(N) may be representative of a distributedcomputing environment, such as a cloud services computing environment.

CONCLUSION

Although the techniques have been described in language specific tostructural features and/or methodological acts, it is to be understoodthat the appended claims are not necessarily limited to the specificfeatures or acts described. Rather, the specific features and acts aredisclosed as exemplary forms of implementing such techniques.

What is claimed is:
 1. A method comprising: creating, using an imagingdevice, a three dimensional (3D) object from an initial pose of a user;mapping, using a body reference mapping, features of the 3D object toparts of the user sensed by the imaging device, wherein the bodyreference mapping allows the user to interact with the 3D object in afirst-person editing perspective; editing, using the body referencemapping, the 3D object by: determining, using the body referencemapping, an edit operation to be performed on the 3D object; performingthe edit operation on the 3D object based at least in part on a gestureof the user that is sensed by the imaging device; and causing, duringperformance of the edit operation, presentation of the 3D object to theuser; and animating the 3D object based on additional gestures of theuser, wherein the animating the 3D object includes moving the featuresof the 3D object based on movement of the gesture of the user.
 2. Themethod as recited in claim 1, wherein the performing the edit operationincludes: selecting at least a portion of a surface of the 3D objectbased on a first part of the gesture of the user; and modifying the atleast a portion of the surface of the 3D object based on a second partof the gesture of the user.
 3. The method as recited in claim 1, whereinthe 3D object is an avatar.
 4. The method as recited in claim 1, whereinthe edit operation is at least one of a push operation, a dragoperation, a sketch operation, a sculpt operation, a cut operation, or apaint operation.
 5. The method as recited in claim 1, further comprisingstoring the 3D object for access by another computing device.
 6. Themethod as recited in claim 1, further comprising: receiving a selectionof an existing 3D object, and adding the existing 3D object to the 3Dobject.
 7. The method as recited in claim 6, further comprisingobtaining the existing 3D object by scanning a real world object usingthe imaging device.
 8. The method as recited in claim 1, wherein thedetermining the edit operation includes identifying a tool based onobject recognition or based on the gesture.
 9. The method as recited inclaim 1, further comprising receiving a voice command using amicrophone, and wherein the determining the edit operation or theperforming the edit operation is based at least partly on the voicecommand.
 10. A system comprising: an imaging device to detect gesturesof a user; one or more processors; and memory to store computer readableinstructions that, when executed on the one or more processors, causethe one or more processors to perform acts comprising: creating, usingthe imaging device, a three dimensional (3D) object from an initial poseof the user; mapping, using a body reference mapping, features of the 3Dobject to parts of the user sensed by the imaging device, wherein thebody reference mapping allows the user to interact with the 3D object ina first-person editing perspective; identifying, using the bodyreference mapping, a gesture of the user based on information receivedfrom the imaging device; determining, using the body reference mapping,an edit operation to be performed on the 3D object based at least inpart on the gesture; modifying the 3D object using the edit operation;causing, during modifying of the 3D object using the edit operation,presentation of the 3D object to the user; and animating the 3D objectbased on additional gestures of the user, wherein the animating the 3Dobject includes moving the features of the 3D object based on movementof the gesture of the user.
 11. The system as recited in claim 10,wherein the edit operation modifies a location of at least a portion ofa surface of the 3D object based on movement of the user during thegesture.
 12. The system as recited in claim 10, wherein the determiningthe edit operation is based at least in part on identification of a toolheld by the user and detected by the imaging device.
 13. The system asrecited in claim 10, wherein creating the 3D object includes using atleast one of voxel modeling or implicit surface modeling.
 14. The systemas recited in claim 10, wherein the 3D object is an avatar, and whereinthe acts further comprise animating the avatar based on movements of theuser.
 15. One or more memory storing computer-executable instructionsthat, when executed on one or more processors, causes the one or moreprocessors to perform acts comprising: obtaining a three dimensional(3D) object from an initial shape of a user; mapping, using a bodyreference mapping, features of the 3D object to parts of the user sensedby an imaging device, wherein the body reference mapping allows the userto interact with the 3D object in a first-person editing perspective;determining, using the body reference mapping, an edit operation to beperformed on the 3D object; performing the edit operation on the 3Dobject based at least in part on a gesture of the user that is sensed bythe imaging device; causing, during performance of the edit operation,presentation of the 3D object; and animating the 3D object based onadditional gestures of the user, wherein the animating the 3D objectincludes moving the features of the 3D object based on movement of thegesture of the user.
 16. The one or more memory as recited in claim 15,wherein the edit operation modifies a location of at least a portion ofa surface of the 3D object based on movement of the user during thegesture.